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Chapter  1 


Introduction 


l. 1.  Formulation 

Many  decision  making  problems  can  be  formulated  as  a  0-1  integer 
program.  The  computation  time  for  the  existing  algorithms  for 
solving  these  problems  increases  rapidly  with  the  size  of  the 
problem.  Even  with  today's  computers,  sometimes  it  is  not  possible 
to  obtain  optimal  solutions  for  these  problems.  Therefore,  heuristic 
procedures  can  either  be  used  to  find  a  good  approximate  solution  to 
the  problem  or  to  increase  the  efficiency  of  an  optimal  algorithm  by 
obtaining  a  good  starting  solution. 

This  thesis  presents  heuristic  procedures  for  0-1  linear 
programming  problems.  These  are  based  on  Eillier's  heuristic 
procedures  for  pure  integer  linear  programming  [7,16,18].  The 
original  procedures  when  tested  were  consistently  close  to  optimal 
and  frequently  had  actually  been  optimal.  They  were  designed  for 
general  integer  programming  problems.  Therefore,  they  were  mainly 
tested  on  such  problems.  The  aim  in  this  thesis  has  been  to 
streamline  these  procedures  to  exploit  the  structure  of  0-1  integer 
programming.  The  procedures  were  designed  for  the  following  pure  0-1 
integer  programming  problem. 
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Three  main  procedures  have  been  studied.  Some  of  these 
procedures  assume  some  of  the  following: 


ci  >0 


*u  >0 


b±  >  0 


Cj  is  an  integer 


(j  -  1,2,  .  .,n) 


(i  =  1,2,  .  . ,m) 
(j  =■  1,2,  .  . ,n) 


(i  ■  1,  •  • ,m) 


(J  =  1,2,  .  . ,n) 


Procedure  3  assumes  all  four.  Therefore,  it  is  designed  for 
multi-constraint  knapsack  type  problems.  Procedure  2  assumes  (4), 

(6)  and  (7).  However,  since  (5)  is  not  assumed,  a  problem  with 
negative  objective  coefficients  can  easily  be  transformed  into  the 

•  I 

required  form  by  substituting  (l  -  x^  )  throughout  the  model  (where  x^ 
also  is  a  binary  variable)  for  each  x^  with  Cj  <  0.  Procedure  1 
assumes  only  (7)  and  that  the  set  of  solutions  that  satisfy 
constraints  (1)  and  (2)  possesses  an  interior  point.  Note  that  any 
objective  function  with  rational  coefficients  can  be  transformed  to 
satisfy  (7)  bv  multiplying  through  by  a  common  denominator. 
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The  notation  used  throughout  this  thesis  is  consistent  with 
[16,18],  For  Procedure  1  and  parts  of  Procedures  2  and  3,  the 
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constraints  are  normalized  so  that  they  become: 
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b'  is  the  Euclidean  distance  from  the  hyperplane,  E  a(,x,  =  b. ,  to 
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the  origin. 
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1.2  Survev  of  Related  Work 


Over  the  past  30  years,  there  has  been  substantial  research  on 
developing  algorithms  for  finding  an  optimal  solution  for  integer 
programming  problems.  In  [9]  these  algorithms  are  grouped  according 
to  whether  they  are  based  primarily  on  enumeration.  Bender's 
Decomposition,  cutting  planes,  or  group  theory.  Enumerative 
algorithms  include  those  which  use  implicit  enumeration  and  branch- 
and-bound.  For  the  pure  integer  programming  problem,  enumerative 
algorithms  have  been  developed  by  Balas  [1],  Hillier  [17],  Faaland 
and  Hillier  [7],  Geoffrion  [8],  Glover  [10],  Hammer  and  Rudeam  [15], 
Lemke  and  Spielberg  [22],  and  Woiler  [33],  among  others.  The  above 
algorithms  base  their  fathoming  tests  mainly  on  the  logical 
implications  of  the  problem  constraints.  The  first  branch-and-bound 
algorithm,  which  was  developed  by  Land  and  Doig  [21]  for  mixed  as 
well  as  pure  integer  programs,  bases  its  fathoming  test  mainly  on 
associated  linear  programs.  An  improved  variation  of  this  algorithm 
subsequently  was  developed  by  Dakin  [5].  Bender's  approach  [3]  is 
used  for  mixed  integer  programming,  since  it  essentially  decomposes  a 
mixed  problem  down  to  solving  an  alternating  sequence  of  pure  integer 
and  pure  linear  problems.  The  cutting-plane  approach  was  the  first 
general  aporoach  taken  to  solving  integer  programs.  The  foundations 
of  this  approach  were  laid  by  Gomory  [11,12].  His  algorithms  deal 
with  dual  feasible  solutions,  so  that  a  primal  feasible  all-integer 
solution  is  not  obtained  until  an  optimal  solution  Is  reached.  The 
Group  Theoretic  approach  also  was  intlated  by  Gomory  [13].  Further 
studies  of  this  type  have  been  done  by  Shapiro  [27,28,29],  Glover 
[10],  Thlrlez  [30],  and  Wolsey  [34].  This  approach  is  generally 


applied  to  pure  integer  problems.  A  more  recent  algorithm  by  Crowder 
et  al.  [4],  uses  a  combination  of  problem  preprocessing,  cutting 
planes,  and  the  branch-and-bound  technique.  Their  computational 


experience  on  large  scale  pure  zero-one  linear  problems  has  been 
impressive. 

Because  of  the  significant  computational  limitations  of  integer 
programming  algorithms  for  obtaining  an  optimal  solution,  there  has 
been  considerable  research  on  heuristic  algorithms  for  efficiently 
seeking  very  good  solutions  that  are  not  guaranteed  to  be  optimal. 
Such  algorithms  have  been  developed  by  Balas  and  Martin  [2],  Reiter 
and  Rice  [23],  Echols  and  Cooper  [6],  Senju  and  Toyoda  [26],  Hillier 
[16,18],  Faaland  and  Hillier  [7],  Roth  [25],  Kochenberger ,  McCard  and 
Wyman  [20],  Ibaraki,  Ohashi,  and  Mine  [19],  and  Toyoda  [30].  The 
ones  presented  in  [2],  [26]  and  [31]  are  specifically  designed  for 
the  binary  integer  programming  case. 

Balas  and  Martin  [2]  use  the  fact  that  a  0-1  program  is 
equivalent  to  the  associated  linear  program  with  the  added 
requirement  that  all  slack  variables,  other  than  those  in  the  upper 
bound  constraints,  be  basic.  Toyoda  [31]  assigns  measures  of 
preferability  to  zero-one  variables  that  change  the  values  of  the 
variables  from  zero  to  one.  Senju  and  Toyoda  [26]  start  the 
heuristic  search  from  an  initial  solution  which  has  all  Xj  =  1 ,  and 
then  the  variables  that  provide  the  smallest  contribution  to 
objective  function  increase  per  unit  of  weighted  infeasibility  are 
dropped  to  zero. 

Since  the  heuristic  procedures  developed  in  this  thesis  for  0-1 
integer  programming  are  based  on  Hillier' s  procedures  for  general 


integer  programming,  Hillier's  procedures  are  described  in  some 
detaiL  in  the  next  chapter  under  the  label  of  "Original  Procedures." 

Zanakis  [35]  examined  the  performance  of  three  heuristic  methods 
(Sen.iu-Toyoda  [261,  Kochenberger  et  al.  [20],  and  Hillier  [16])  when 
applied  to  the  0-1  linear  programming  problem  with  nonnegative 
coefficients. 

Since  the  latter  two  algorithms  were  designed  for  general 
integer  linear  programming,  Zanakis  simply  added  upper  bounds  of  one 
on  the  variables  without  any  streamlining  for  this  special  structure 
(not  even  the  upper  hound  technique  for  the  simplex  method).  The 
effectiveness  of  each  algorithm  was  measured  in  terms  of  computing 
time,  error  and  relative  error.  According  to  the  test  results, 
Hillier's  algorithm  was  the  most  accurate  but  not  as  fast  as  the 
other  two.  Kochenberger ' s  et  al.  heuristic  was  the  fastest  of  the 
three  in  tightly  constrained  problems.  In  general,  the  Senju-Toyoda 
algorithm  tended  to  be  the  fastest,  but  was  the  least  accurate  on 
small  and  medium  size  problems. 

The  heuristic  algorithms  developed  here  are  designed  so  that 
they  will  be  as  accurate  as  Hillier's  original  algorithms  without 
requiring  as  much  computational  effort  because  they  are  designed 
specifically  for  the  0-1  integer  programming  case. 


Chapter  2 


Construction  of  the  Procedures 

In  constructing  Procedures  1,2  and  3,  the  aim  has  been  to 
decrease  the  computation  time  for  Hillier's  pure  Integer  Programming 
Heuristic  Procedures  by  considering  that  the  values  of  the  variables 
can  only  be  0  or  1.  For  Procedures  2  and  3,  the  additional  special 
structure  assumed  also  is  considered. 

The  original  procedures  have  a  three-phase  approach.  Phase  1 
identifies  a  general  region  within  which  to  explore  for  good  feasible 
solutions  by  finding  the  optimal  non-integer  solution  by  the  simplex 
method  and  a  second  point  well  into  the  feasible  region.  Phase  2 
searches  for  a  feasible  integer  solution  by  moving  along  the  line 
segment  from  the  first  point  to  the  second  to  initiate  searches. 

Phase  3  tries  to  improve  on  the  feasible  solution  obtained  in  Phase 
2.  The  final  solution  in  this  phase  is  the  desired  approximate 
solution. 

In  the  present  procedures,  certain  changes  have  been  made  in 
different  phases.  In  the  original  procedures,  alternative  methods 
were  introduced  for  each  phase.  After  examining  the  test  results  of 
the  original  procedure  [16,18],  the  apparent  best  method  for  each 
phase  has  been  selected.  In  some  cases,  phases  have  been  changed 
completely  in  order  to  find  a  more  appropriate  method  for  the  0-1 
integer  programming  case.  Each  procedure  will  be  described  in  detail 
in  the  following  sections. 


2.  1  Procedure  1 


Procedure  1  is  based  directly  on  the  heuristic  procedures  for 
general  ILP  in  [16],  Therefore,  it  also  has  three  phases.  Certain 
changes  and  streamlining  have  been  incorporated  into  each  phase.  The 
following  subsections  give  a  summary  description  of  each  phase  of  the 
original  procedures  followed  by  a  discussion  of  the  changes  and 
streamlining  for  the  0-1  case. 

a.  Phase  1 

(i)  Original  Procedures 

Phase  1  of  this  procedure  starts  by  solving  the  LP-relaxation  of 

the  problem  to  find  its  optimal  solution  The  next  step  is  to 

(2) 

find  a  second  point  xv  '  well  into  the  feasible  region.  Phase  1  ends 
by  constructing  the  line  segment  between  the  two  points.  [16] 
provides  two  methods  (labeled  1  and  2)  for  finding  x^2\  [7] 
generalizes  the  approach  to  finding  a  piecewise  linear  path,  and  [18] 
provides  another  generalization. 

(ii)  Changes  for  the  0-1  Case 

For  the  first  step,  the  simplex  method  with  the  upper  bound 
technique  is  used  to  find  Methods  1  and  2  of  the  original 

procedures  do  not  require  that  either  ^  or  the  corresponding 
rounded  solution  satisfy  all  of  the  constraints  (2)  and  (3)  that  are 
not  binding  at  x*'^.  Therefore,  an  interior  path  found  by 
considering  all  the  constraints  rather  than  only  those  that  are 
binding  at  x^ ^  should  be  more  effective  in  Phase  2.  The  following 
two  methods  drawn  from  [7]  give  piecewise  linear  interior  paths. 


The  first  method,  which  will  be  denoted  as  la,  generates  the 


piecewise  linear  path  by  obtaining  the  parametric  solution  to  the 
linear  program: 

max  r , 

subject  to: 


n 

E  aljX  +  V  <  bt  (i  “  1.2,  .  • ,m) 

J=l  J 

n 

E  c ,  x .  =  Z 

j=i  J  1 

X.  <  1 

(j  =  1*2,  .  • ,n) 

Xj  >  0 

r  >  0 

as  Z  is  decreased  from  its  value  at  x'*\  and  then  deleting  r  from 

the  parametric  solution.  This  method  stops  when  max  r  reaches  its 

(2) 

largest  value,  and  the  corresponding  solution  for  x  is  xv  '• 

The  second  method,  2a,  obtains  the  breakpoints  of  the  piecewise 
linear  path  as  the  basic  feasible  solutions  (after  deleting  r) 
generated  in  the  process  of  solving  the  following  problem: 
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E  a, .x.  +  A. r  <  b. 

j-i  11  J  1  1 


(i  —  1*2,  •  •  ,ni ) 


*j  ‘  * 


>  0 


( j  —  1,2,  •  . ,n) 


r  >  0 


starting  with  the  Initial  solution  x'  .  The  solution  for  x  that 


maximizes 


r  is  x<2>. 


For  either  method,  A^  can  he  one  of  the  following: 


A.  -  1/2  E  |a  ' 
1  eB 


n  1/2  1/2 

A  =  1/2  (  E  a^)  N  (ii) 

1=  i  J 


A  =  (  E  a  ) 

J-l  J 


(iii) 


where  B  is  the  set  of  basic  variables  from  among  {xj,X2«  •  *»xn}  1° 


x'1'  and  N  is  the  number  of  elements  in  B. 


An  alternative  to  Methods  la  and  2a  would  be  to  use  the  linear 


path  between  x^ ^  and  x^2^  instead  of  the  piecewise  linear  path  for 


initiating  the  search  for  a  feasible  solution.  Since  both  methods 


obtain  the  same  x^  ,  the  quicker  Method  2a  should  be  used.  Using 


Method  2a  to  obtain  x'  '  and  then  simply  constructing  the  linear  path 


between  x^^  and  is  labeled  as  Method  2b. 

Method  la  requires  a  software  package  that  includes  parametric 
programming  as  well  as  a  considerable  amount  of  execution  time.  The 
available  computer  package  for  this  study,  Lindo,  did  not  include 
parametric  programming.  Considering  that  Methods  2a  and  2b  require 
less  time,  they  were  chosen  for  Procedure  1.  Test  results  in  [7] 
show  that  the  first  definition  of  should  be  preferred  to  the 
second  one.  Therefore  the  first  and  third  definitions  are  used. 

When  Method  2a  is  used,  the  sequence  of  basic  feasible  solutions 
generated  is  recorded  and  each  successive  pair  is  connected  by  a  line 
segment  to  form  a  piecewise  linear  path.  For  Method  2b,  only  the 
line  segment  joining  x^  ^  and  x^^  is  used  for  the  search.  This 
completes 
Phase  1. 

b.  Phase  2 

(i)  Original  Procedures 

The  aim  of  this  phase  is  to  find  a  feasible  0-1  solution  between 

the  two  points,  and  found  in  Phase  1.  Method  1  for  Phase 

2  consists  of  moving  continuously  down  the  line  segment  from  x^^  to 
(2) 

xv  ’ ,  rounding  to  the  nearest  integer  solution,  until  the  rounded 
solution  is  feasible.  Any  point  on  the  line  segment  can  be 
represented  as: 

x  =  (1-a)  x'  +  a  x" 


where  0  <  a  <  l 


a  is  first  set  to  0;  if  the  solution  obtained  by 


rounding  x  is  feasible,  then  Phase  2  terminates  with  this  as  the 
desired  feasible  solution.  If  the  solution  obtained  by  rounding  x  is 
not  feasible,  then  a  is  increased  to  the  next  such  that  the  resulting 
x  obtained  would  give  a  different  rounded  solution.  Phase  2  ends 
when  a  is  greater  than  1  or  a  feasible  solution  is  obtained. 

Method  2  differs  from  Method  1  in  that  a  is  increased  by  fixed 
amounts  and  each  time  the  nearby  region  is  searched  for  a  feasible 
0-1  solution.  For  each  value  of  a,  the  first  step  is  to  apply 
scientific  rounding  to  the  components  of  x  in  order  to  identify  the 
nearest  integer  solution.  If  the  rounded  solution  is  not  feasible, 
then  check  to  see  if  increasing  or  decreasing  any  variable  by  one 
will  decrease  the  " infeasibility"  q.  If  there  are  no  such  variables, 
then  go  to  the  next  value  of  a.  If  there  is  exactly  one  such 
variable,  then  make  this  change.  If  there  is  more  than  one  variable 
that  can  be  changed  to  decrease  the  infeasibility  q,  then  select  the 
one  which  will  give  the  largest  "improvement"  p. 

Using  the  notation,  (y)+=  max  {0 , y } ,  two  alternative 
definitions  of  the  "infeasibility”  q  are  the  following: 


(i)  q  =  E  (  E  a’  x  -  b’ )  , 

i=l  j=i  J  J 


which  is  the  sum  of  the  Euclidean  distances  between  x  and  each  of  the 
violated  constraining  hyperplanes; 


(ii)  q  =  «axlc|1> 


n 


which  is  the  maximum  of  the  Euclidean  distances  between  x  and  the 


violated  constraining  hyperplanes 


Three  alternative  definitions  of  the  "improvement"  p  are  the 
following: 


(i)  p  =  -  Aq , 


where  Aq  is  the  change  in  q  resulting  from  the  change  in  the  variable 


( ii)  p  =  Cj  AXj  /  (-Aq) , 


where  Ax.  is  the  change  in  x*  being  made; 
J  -* 


(lit)  p  =  - Aq  +  Cj  AXj 


where  c'.  is  the  normalized  value  of  c*. 

J  ^ 

The  first  definition  of  p  is  a  natural  measure  for  the 
"improvement"  in  infeasibility  obtained  by  changing  the  value  of  a 
variable  x  j  ,  but  it  does  not  take  into  account  the  change  in  the 
value  of  the  objective  function.  The  second  definition  of  p  does 
take  this  into  account  by  selecting  the  change  that  increases  the 
objective  function  the  most  per  unit  decrease  in  q.  Therefore,  when 
the  feasible  solution  is  reached,  the  objective  function  value  will 
tend  to  be  relatively  large.  The  third  definition  is  similar  to  the 
first  one  except  for  an  added  terra  that  also  considers  the  effect  on 
the  objective  function.  This  definition  encourages  large  moves 
toward  the  most  attractive  portion  of  the  feasible  region. 


I  3 


With  alternative  definitions  of  p  and  q,  different  criteria  can 
be  found  for  choosing  the  variable  to  be  changed.  Using  the  notation 
in  (16,18],  some  of  these  criteria  are  as  follows: 


Criterion  A:  first  definiton  of  p,  first  definition  of  q 
Criterion  B:  first  definition  of  p,  second  definition  of  q 
Criterion  C:  second  definition  of  p,  first  definition  of  q 
Criterion  D:  second  definition  of  p,  second  definition  of  q 
Criterion  E:  third  definition  of  p,  first  definition  of  q 
Criterion  S:  first  definition  of  q.  This  is  a  streamlined 

approach.  As  soon  as  a  possible  change  that  yields 
an  improvement  is  found,  it  is  implemented  without 
finding  and  comparing  all  the  other  improving 


changes. 


Criteria  A  and  B  are  based  on  the  measurement  of  the  infeasibility 
and  they  do  not  consider  the  change  in  the  objective  function.  When 
the  original  procedures  were  tested  in  [18]  the  results  showed  that 
Criterion  A  was  generally  better  than  B.  Since  these  two  criteria 
differ  only  in  their  definition  of  q,  this  suggests  that  the  first 
definition  of  q  is  superior  to  the  second.  For  this  reason. 
Criterion  C  should  be  preferred  to  D.  Further  testing  with  the 
original  procedures  [18]  has  been  done  to  try  to  distinguish  between 
the  four  remaining  criteria,  A,  C,  E  and  S.  However,  the  main 
conclusion  is  that  even  though  large  differences  can  occur  on 
individual  problems,  the  choice  of  a  particular  criterion  does  not 
have  a  strong  effect  on  the  average  performance  of  the  heuristic 


procedure  In  the  long  run. 

Method  3  Is  a  combination  of  Methods  1  and  2.  As  In  Method 
1,  a  Is  Increased  at  each  Iteration  by  the  mlnumum  amount  required  to 
obtain  a  different  rounded  solution.  However,  rather  than  only 
checking  this  rourded  solution  for  feasibility,  the  nearby  region  Is 
also  explored  as  In  Method  2. 

(ii)  Changes  for  the  0-1  Case 

In  the  present  procedure,  Method  3  with  Criterion  A  has  been  used 
to  find  a  feasible  0-1  solution  between  the  two  points,  and  x^\ 

found  in  Phase  1.  In  this  case,  the  components  of  x^  ^  and  x^^  are 
betw  en  0  and  1  and  the  entire  path  between  them  generated  by  Method 
2a  or  2b  of  Phase  1  also  has  this  property,  so  every  rounded  solution 
along  this  path  Is  a  0-1  solution.  If  Method  2a  had  been  used  In 
Phase  1,  the  first  Iteration  for  Phase  2  starts  with  x'  as  x^1^  and  x" 
as  the  first  basic  feasible  solution  In  finding  The  search  Is 

Initiated  from  the  line  segment  between  these  two  points.  If  a 
feasible  solution  Is  found,  Phase  2  ends,  but  If  a  feasible  solution 
is  not  found,  the  search  Is  continued  from  the  next  line  segment, 
which  Is  the  line  joining  the  first  and  second  basic  feasible 
solutions  obtained  in  finding  xv  '•  If  no  feasible  solution  is  found 
on  this  line  segment  move  to  the  next  one,  etc.,  until  a  feasible 
solution  Is  found.  Method  2b  of  Phase  1  yields  just  a  single  line 
segment  for  Phase  2.  Certain  adjustments  have  been  made  for  the  0-1 
case  in  different  steps  of  Method  3.  These  are  as  follows.  Every 
Integer  solution  considered  now  is  required  to  be  binary.  Therefore, 
when  Step  6  of  Methods  2  and  3  in  [16]  determines  In  which  direction 


each  variable  should  be  changed  In  order  to  decrease  the 
Infeaslblllty,  the  change  would  be  considered  now  only  if  It  would 
result  in  a  0-1  solution. 

Phase  2  ends  as  soon  as  a  feasible  solution  is  found.  There  is 
no  guarantee,  in  general,  that  this  will  occur. 

c.  Phase  3 

(i)  Original  Procedures 

Phase  3  starts  with  the  feasible  solution  found  in  Phase  2  and 
then  tries  to  improve  on  it.  This  was  initially  done  by  alternating 
two  modes.  The  first  mode  tries  to  increase  the  objective  function 
value  by  increasing  or  decreasing  the  value  of  a  single  variable  by 
one,  at  the  same  time  keeping  the  solution  feasible.  Two  alternative 
methods  are  considered  for  this  mode.  When  determining  how  much  each 
variable  can  be  changed  in  the  favorable  direction.  Method  1  imposes 
Integer  restrictions  on  these  quantities,  whereas  Method  2  does 
not.  Test  results  in  [18]  suggested  that  Method  1  is  better  than 
Method  2.  Therefore,  since  its  relative  appeal  is  even  stronger  in 
the  0-1  integer  programming  case,  it  was  chosen  for  the  present 
procedures. 
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changing  two  variables  simultaneously. 

(ii)  b.  Changes  for  the  0-1  Case  in  the  Second  Mode 

In  Step  1  of  Part  IV,  in  addition  to  checking  the  sign  of  +6 
a  check  is  made  whether  Xj  +  6j  <  1  before  permitting  the  change  6  ^ . 
The  other  change  in  this  part  is  that  once  a  change  is  made  on  a 
variable  in  the  favorable  direction,  it  is  never  considered  again,  i. 
the  loop  which  goes  back  to  Step  1  from  Step  3  is  removed.  In  Step  6 
of  Part  V  and  Part  VI,  is  set  to  1.  In  Part  VII,  after  once 
considering  a  variable  for  change  in  the  direction  which  would 
decrease  the  objective  function  value,  it  is  never  considered  again, 
i.e.,  the  loop  which  goes  back  to  Step  1  from  Step  5  is  removed. 

The  two  modes  above  are  applied  alternately  until  no  better 
solution  is  found.  This  approach  constitutes  the  first  part  of  the 
method  that  has  been  used  in  the  present  procedures. 

(iii)  Other  Methods  from  Original  Procedures 

Three  other  methods  have  been  considered,  namely,  Methods  3,  4 
and  5  from  (18).  Method  3  starts  with  just  the  first  mode  of  search 
described  above  before  undertaking  a  new  mode  of  search.  Methods  4 
and  5  complete  Method  I  of  Phase  3  (both  modes  of  search)  before  they 
start  the  additional  search  for  further  improvement.  In  these 
methods,  the  new  modes  of  search  involve  changing  many  variables  in 
order  to  reach  a  better  solution.  It  is  computationally  infeasible 
for  large  problems  to  consider  all  ways  of  changing  several  variables 
simultaneously.  Therefore,  methods  that  will  efficiently  consider 


only  promising  ways  of  changing  many  variables  are  needed.  Let  x^) 
denote  the  current  best  feasible  solution  and  z^)  its  objective 
function  value.  All  three  methods  are  initiated  by  adding  a  new 
constraint,  cx  >  bQ  where  b^  =  +  1,  to  the  problem.  This  makes 

infeasible  and  reduces  the  feasible  region  so  that  it  only 
contains  better  feasible  solutions.  In  all  of  the  methods,  one 
begins  by  moving  from  x^)  through  a  sequence  of  infeasible  points 
that  try  to  progress  to  a  better  feasible  solution. 

Methods  3  and  4  go  through  n  cycles,  in  the  general  integer 
programming  case,  where  each  one  begins  by  changing  one  of  the  n 
variables  in  the  favorable  direction.  The  first  step  in  each  cycle 
gives  a  new  solution  which  is  not  feasible.  Then  a  procedure  similar 
to  the  one  in  Phase  2  is  repeated.  In  other  words,  one  tries  to 
decrease  the  "infeasibility",  q,  by  making  changes  in  the  variable 
which  will  give  the  best  "improvement"  p. 

Method  5  is  similar  to  Method  4,  but  instead  of  n  cycles,  there 
is  only  one.  It  starts  with  x^L^,  which  now  is  infeasible  because  of 
the  new  constraint,  cx  >  bQ.  It  then  follows  a  procedure  similar  to 
the  one  in  Phase  2  for  finding  a  feasible  solution.  As  adapted  here, 
each  iteration  consists  of  finding  which  variable  would  give  the 
largest  "improvement"  p  according  to  Criterion  A  if  the  variable  were 
changed  to  its  other  binary  value,  and  then  making  that  change. 

Sometimes,  largest  p  might  be  negative  so  this  change  will 
increase  the  infeasibility.  Thus  it  might  be  necessary  to  move  away 
from  the  feasible  region  initially,  in  order  to  be  able  to  eventually 
find  a  better  feasible  solution.  It  is  possible  that  a  feasible 
solution  is  never  reached.  Therefore,  to  avoid  moving  away  from  the 


feasible  region  indefinitely,  an  upper  limit,  100  is  imposed  on  the 
number  of  iterations. 

Both  Method  3  and  Method  4  require  more  than  some  multiple  of 

2 

mn  elementary  operations,  so  that  the  running  time  grows  rapidly 
with  the  size  of  the  problem.  Furthermore,  previous  testing  [18] 
suggests  that  Method  5  tends  to  do  beter  than  Methods  3  and  4  in 
reaching  a  better  feasible  solution  that  requires  changing  many 
variables,  apparently  because  of  its  drifting  ability. 

(iv)  Changes  for  the  0-1  Case 

Method  5  has  been  chosen  for  the  present  procedures.  The  only 
change  from  the  description  in  [18]  is  that  the  only  trial  solutions 
considered  now  are  0-1  solutions. 


2.2  Procedure  2 


This  procedure  assumes  (4),  (6)  and  (7).  It  starts  with  all  the 
variables  at  0,  which  is  a  feasible  solution  for  (1)  -  (3).  It  then 
tries  to  raise  the  most  promising  variables  to  1.  This  is  done  by 
finding  how  much  each  variable  can  be  increased  before  it  becomes 
infeasible  according  to  (1).  In  particular,  let 

b^/  3  j  j ,  if  3  ^ j  ^  0 

+  ®,  if  a, .  <  0 

ij 

for  i  =  1,2,  .  . ,m  and  j  =  1,2,  .  . ,n, 

and 


f 


R,  *  min  K, ,  ,  for  j  =  i,2,  .  . ,n. 

J  i-l,2,..m 

Then  Rj  indicates  how  much  the  variable  Xj  can  be  increased  before 
violating  (l).  Now  let 

Range  (xj)  =  [Rj ]  =  (greatest  integer  <  R^ )  , 

for  j  =  1 ,2 ,  .  . ,n. 

If  there  are  k  or  more  variables  with  Range  >  k,  then  this  means  that 
k  of  these  variables  can  be  set  to  1  while  retaining  feasibility. 
Because  of  (4),  increasing  any  variable  Xj  to  1  can  only  increase 
z(c^  >  0)  or  leave  it  unchanged  (cj  =  0). 

Each  iteration  begins  by  finding  the  largest  integer  k  such  that 
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at  least  k  variables  have  Its  Range  >  k.  If  there  are  exactly  k 
variables  with  Range  >  k,  then  set  all  of  them  to  1.  If  there  are 
more  than  k  such  variables,  then  set  the  k  such  variables  with  the 
highest  objective  row  coefficients  to  1. 

After  setting  k  variables  to  1,  the  right  hand  side  is  adjusted 
In  the  following  way.  Let  D  be  the  set  of  indices  of  the  k  variables 
which  were  just  set  to  1.  Reset 


bl  =  ^  ‘  jeD^ 


for  1  =  1,2, 


New  values  are  found  for  R  and  Range  with  the  adjusted  b^'s.  The 
same  procedure  is  repeated  except  for  the  variables  which  are  already 
at  1.  These  variables  are  not  considered  again.  This  part  of  the 
procedure  ends  when  Range  is  equal  to  0  for  all  the  variables.  The 
above  process  can  be  summarized  as  follows: 


1.  Set  E  =  0. 


2.  Calculate  Kjj  for  i  =  1,2,  .  . ,m  and  j  =  1,2, 


•  •  >  I  • 


3.  Calculate  Rj  for  j  =  1,2,  .  .,n. 

A.  Calculate  Range(xj)  for  j  =  1,2,  .  . ,n. 

5.  Determine  the  largest  integer  k  such  that  there  are  k  or  more 
variables  with  Range  >  k,  and  add  the  variables  with 

Range  >  k  to  the  set  E. 

6.  If  k  =  0,  then  go  to  step  8.  Otherwise,  if  E  has  exactly  k 

elements,  then  set  all  of  them  to  1;  if  E  has  more  than  k 

elements,  then  just  set  k  variables  in  E  with  the  highest 

objective  row  coefficients  to  1. 


2  1 


7.  Adjust  the  right  hand  side  and  return  to  step  2. 

8.  Stop. 

The  above  process  constitutes  the  first  part  of  this 
procedure.  The  second  part  starts  with  the  feasible  solution 
obtained  from  the  first  part.  It  then  tries  to  improve  on  it. 

Method  5  of  Procedure  1  is  used  here.  Before  starting  Method  5,  the 
problem  is  normalized.  Therefore,  Procedure  2  differs  from  Procedure 
1  in  that  Phases  1  and  2  of  Procedure  1  is  replaced  by  the  first  part 
of  Procedure  2  for  finding  an  initial  good  feasible  solution. 


2.3  Procedure  3 


Procedure  3  Is  similar  to  Procedure  2  in  that  it  tries  to  find  a 
feasible  solution  in  the  first  part  and  then  adopts  Method  5  of 
Procedure  1  to  find  a  better  feasible  solution  in  the  second  part. 
Both  procedures  assume  that  b^  >  0  for  i  =  1,  .  .  ,m  and  Cj  >  0  for 
j  =  1,2,  .  .,n,  whereas  Procedure  3  also  assumes  that  a^j  >  0  for 
i  =  1,2,  .  . ,m  and  j  =  1,2,  .  . ,n.  The  first  part  of  Procedure  3 
also  starts  with  all  variables  at  0.  The  most  promising  variables  to 
be  set  to  1  are  found  in  a  slightly  different  manner.  R  is  found  in 
the  same  way  as  before.  Now  a  new  quantity 


is  calculated  for  each  variable.  This  is  a  measure  of  how 
"profitable"  (increase  in  the  objective  function)  each  variable  can 
be  if  it  alone  were  to  be  increased  as  much  as  (1)  permits.  In 
actuality,  any  variable  that  is  increased  would  be  increased  to  1. 

It  is  desirable  to  choose  the  variables  to  be  increased  in  a  way  that 
will  allow  further  improvements.  Therefore,  it  is  necessary  to 
consider  the  coefficients  of  each  variable  in  the  functional 
constraints  (1).  Choosing  a  variable  to  increase  that  has  a 
relatively  small  sum  of  these  coefficients  should  tend  to  leave 
relatively  good  opportunities  for  further  improvements  by  then 
Increasing  other  variables.  Let 

m 

"]  '  'ir  for  j  -  1,2,  . 
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(If  the  coefficients  of  variables  in  different  constraints  differ 


significantly,  then  (l)  needs  to  be  normalized  as  shown  at  the  end  of 


Section  1.1  in  order  for  A  to  make  sense  in  the  rest  of  the 


procedure.)  The  measure  which  determines  which  variable  to  set  to  1 


Ratio(Xj)  =  Pj  /  Aj,  for  j  =  1,2, 


It  is  desirable  that  Pj  be  as  high  as  possible  and  A^  as  low  as 
possible.  When  Aj  is  0,  set  Ratio  (xj)  -  +  •  .  If  P j  is  0,  then  set 
Ratio  (xj)  =  0.  The  variable  maximizing  Ratio  is  then  set  to  1. 


This  completes  one  iteration.  To  start  the  next  iteration,  the  right 


ha. id  side  is  adjusted  by  resetting 


bi*  bi  “  aijxj’  ^or  1  •  •  »m  ancl  J  =  1,2,  •  *>n. 


for  purposes  of  recalculating  the  R  j .  Once  a  variable  is  set  to  1, 


it  is  never  considered  again  and  so  is  never  changed  to  0  during  this 


part  of  Procedure  3.  The  iterations  for  this  part  end  when  none  of 


the  remaining  variables  can  be  increased  to  one  while  retaining 


feasibility.  The  above  process  can  be  summarized  as  follows: 


1.  Calculate  Ri  for  j  =  1,2,  .  .,n. 


2.  Calculate  Pi  for  j  =  1,2,  .  . ,n. 


3.  Calculate  Aj  for(j  =  1,2,  .  .,n. 


A.  Calculate  Ratio  (x^)  for  j  =  1,2, 


g m\ 


5.  Determine  the  variable  x^  which  maximizes  Ratio.  If  Ratio 
(x^)  =  0,  then  go  to  step  7;  otherwise,  set  x^  =  1. 

6.  Adjust  the  right  hand  side  and  return  to  Step  1. 

7.  Stop. 


The  second  part  of  the  procedure  starts  with  the  final  feasible 
solution  from  the  first  part  and  improves  on  it  by  Method  5  of 
Procedure  1. 


Chapter  3 

Computational  Experience 


In  order  to  evaluate  and  compare  the  three  procedures  described 
in  Chapter  2,  Pascal  programs  were  written  for  each  and  run  on  a 
DEC20  system  at  Stanford  University.  The  procedures  were  tested  on 
73  problems.  Fifty  seven  of  these  were  generated  randomly,  where  8 
of  these  were  of  Type  I,  16  were  of  Type  II,  21  were  of  Type  II'  and 
11  were  of  Type  III.  The  types  are  as  described  in  Table  I,  where 
the  parameters  are  integers  randomly  generated  for  the  indicated 
intervals. 


Table  I 

DESCRIPTION  OF  THE  RANDOMLY  GENERATED  TEST  PROBLEMS 


Parameter 

Problem  Type 

I 

II' 

III 

Cj' 

[-20,80  ] 

[  0,100  ] 

[  0,100  ] 

[0,100] 

*i.l' 

[-40,60  ] 

[  0,100  ] 

[  0,100  ] 

[0,1  ] 

V 

[  50,200] 

[400,1600] 

[300,1200] 

1 

Xj 

0-1 

0-1 

0-1 

0-1 

Letting  m  be  the  number  of  functional  constraints  and  n  the 
number  of  variables,  eight  problems  of  each  type  have  m  x  n  =  13x13, 
and  the  other  are  larger  (such  as  15x30,  30x15,  30x30,  60x30,  60x60, 
60x120,  60x300).  For  the  problems  with  n  >  300,  the  range  of  the 
right  hand  side  was  changed  to  [4000,8000].  Seventeen  of  the  problems 
tested  were  standard  test  problems  in  the  literature — Haldi's  IBM 
problems  (#4  and  # 6)  and  nine  Allocation  Problems  reproduced  by 
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Hilller  [17].  These  problems  are  denoted  in  the  tables  by  Haldi,  A, 


Pet,  ST,  and  H  respectively. 


Table  II  presents  a  comparison  of  two  definitions  of  A.,  (i) 


and  (ill),  and  two  Phase  1  methods.  The  last  column  of  Table  II 


shows  the  difference  in  the  quality  of  the  final  solution  obtained 


for  each  of  these  eight  problems  with  each  method  in  Phase  1  and  each 


of  the  definitions  of  A^.  The  measure  of  quality  used  throughout 


this  chapter  is  the  "normalized  deviation”  from  the  optimal  solution 


x(opt\  where  the  normalized  deviation  from  optimality  for  a  solution 


x  is  defined  as 


cx(opt)  -  cx 


where  x 


(opt) 


has  been  obtained  by  Lindo.  The  geometrical 


interpretation  of  this  quantity  is  that  it  is  the  Euclidean  distance 


from  x  to  the  hyperplane  cx  =  cx^0Pt\ 


The  times  given  throughout  this  chapter  are  CPU  times  in 


seconds. 


In  Phase  1  of  Procedure  1,  Lindo  has  been  used  on  the  DEC20 


System  to  ohtain  x^^  and  x^),  as  wen  as  the  basic  feasible 


solutions  generated  in  moving  from  x^ ^  to  x^  \  The  times  given 
under  Lindo  in  each  table  are  the  times  used  by  Lindo  to  obtain  x' ^ ' 


and  xv 


Two  definitions  of  A^ ,  (t)  and  (iii),  have  been 


tested  on  eight  Type  I  problems.  Even  though  the  optimal  value  of  r 
and  the  corresponding  values  of  x^)  were  different  for  each 
definition  of  A^,  the  eventual  solutions  obtained  by  Procedure  1  were 
exactly  the  same  for  each  problem.  Therefore,  only  one  definition 
of  A^  was  used  in  the  rest  of  the  testing  process.  The  one  chosen 
was  the  first  definition  (i),  since  it  requires  less  computational 
effort.  On  the  problems  tested.  Method  2b  has  been  much  faster  and 
has  given  the  same  final  solution  from  Procedure  1  as  Method  2a,  as 
suggested  by  Table  IT,  so  only  Method  2b  was  used  on  the  subsequent 
problems. 

However,  in  general,  Methods  2a  and  2b  do  not  necessarily  lead 
to  the  same  final  solution.  Furthermore,  on  problems  where  it  is 
difficult  to  find  a  feasible  solution  in  Phase  2,  the  chances  of 
being  successful  should  be  better  with  Method  2a  than  2b.  Therefore, 
one  can  use  Method  2a  where  a  feasible  solution  is  not  found  by 
method  2b.  One  explanation  for  the  two  methods  giving  the  same  final 

solution  on  the  first  eight  test  problems  might  be  that  in  the  0-1 

(2  ) 

case,  the  basic  feasible  solutions  obtained  in  getting  xv  '  might  not 

(2 ) 

be  very  different  from  x  when  rounded.  Therefore,  rounded 
solutions  used  as  the  starting  points  for  the  Phase  2  searches  for  a 
feasible  solution  might  not  be  very  different  for  the  two  Phase  1 
methods.  One  should  also  add  that,  in  the  general  integer 
programming  case,  the  situation  would  be  different. 

The  three  procedures  have  been  compared  according  to  the  quality 
of  their  final  solutions  and  their  running  times.  A  summary  of  the 
performance  of  these  procedures  is  given  in  Tables  ill,  IV,  V  and 
VI.  Procedures  1,2,  and  3  were  run  on  16  Type  II  problems  and  Table 
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Ill  shows  the  resulting  average  normalized  deviation  from  optimality 
and  execution  time  for  each  problem,  as  well  as  the  overall  averages 
and  the  percentage  of  the  problems  for  which  an  optimal  solution  is 
found.  Even  though  Procedure  2  seems  to  be  faster.  Table  III 
strongly  suggests  that  its  solutions  tend  to  be  inferior  to  those 
from  Procedures  l  and  3  for  this  type  of  problem.  Procedure  1 
obtained  the  optimal  solution  25%  of  the  time,  as  compared  to  31.3% 
for  Procedure  3.  Even  though  these  are  not  very  high  percentages, 
the  average  normalized  deviation  from  optimality  in  both  cases  was 
very  low,  0.07  for  Procedure  1  and  0.06  for  Procedure  3.  This 
suggests  that  solutions  obtained  by  these  procedures  are,  in  general, 
very  close  to  optimal.  When  the  best  solution  for  all  three 
procedures  were  taken,  the  resulting  solution  was  optimal  50%  of  the 
time.  Therefore,  another  way  of  finding  an  approximate  solution  to  a 
problem  would  be  to  run  all  three  procedures  on  the  problem  and  take 
the  best  solution  obtained. 

Another  situation  to  be  tested  is  the  case  where  the  problems 
have  smaller  feasible  regions.  Type  II*  problems  are  a  modified  form 
of  Type  II  problems,  where  the  range  of  the  right  hand  side  has  been 
scaled  down. 

The  three  procedures  were  run  on  18  Type  II'  problems,  and  the 
results  are  shown  in  Table  IV.  In  comparison  to  Table  III,  the 
percentage  of  solutions  that  are  optimal  has  actually  increased  from 
25%  to  27.8%  in  the  case  of  Procedure  i.  For  this  procedure,  there 
is  a  very  small  increase  in  the  average  normalized  deviation  from 
optimality,  from  0.07  to  0.08.  The  average  normalized  deviation  from 
optimality  for  Procedure  3  is  close  to  this,  0.09,  but  the  percentage 
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of  optimal  solutions  has  dropped  from  31.3%  to  11%  for  the  Type  II' 
problems.  Procedure  2  has  again  done  worse  than  these  two.  The 
results  suggest  that  Procedure  3,  in  general,  finds  good  approximate 
solutions  for  the  problems,  but  Procedure  1  is  more  consistent  in 
finding  optimal  solutions.  It  also  suggests  that  Procedure  1  is  not 
affected  by  the  size  of  the  feasible  region  for  a  problem.  However, 
considerably  more  testing  would  be  needed  to  draw  statistically 
significant  conclusions. 

Procedure  3  cannot  be  used  on  Type  I  problems,  so  only  Type  II, 
II'  and  III  problems  can  be  used  for  comparing  all  three  procedures. 
The  results  for  Type  III  problems  are  given  in  Table  V.  The  H  series 
from  Hillier  [17]  also  are  Type  III  problems.  Contrary  to  the 
previous  test  results,  Procedure  2  seems  to  do  very  well  for  this 
type  of  problem  since  it  found  the  optimal  solutions  for  66.7%  of  the 
Type  III  problems.  The  other  two  procedures  did  quite  well  for  this 
type  of  problems  as  well,  namely,  40%  and  26.7%  for  Procedures  1  and 
3,  respectively.  The  average  normalized  deviation  from  optimality 
was  very  small  for  all  three  procedures. 

The  reason  for  Procedure  2  doing  so  well  for  Type  III  problems 
and  so  poorly  on  Type  II  problems  apparently  is  that  Procedure  2 
tries  to  assign  the  value  of  1  to  as  many  variables  as  possible. 

This  strategy  does  not  allow  for  further  changes  in  the  other 
variables.  In  Type  III  problems,  only  very  few  of  the  variables 
equal  1  in  an  optimal  solution,  so  the  Procedure  2  strategy  works 
very  well. 

Comparing  Tables  II,  III,  IV  and  V,  it  can  be  deduced  that  all 
three  procedures  give  better  quality  results  on  Type  III  problems. 
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Procedure  1  seems  to  be  more  consistent  than  the  others  in  its 
quality  of  results  for  different  types  of  problems. 

The  growth  of  execution  time  for  each  procedure  on  larger 
problems  (n  >  15)  can  be  seen  in  Tables  IV  and  V.  Procedures  2  and  3 
solved  problems  with  n  <  120  in  less  than  10  seconds  for  all  but  one 
problem.  The  execution  times  for  Procedure  1  tend  to  be  considerably 
larger,  but  it  still  was  less  than  2  minutes  for  a  problem  with 
n  =  120.  In  general,  for  the  three  problems  with  n  >  300  the 
execution  time  did  not  increase  rapidly  (if  at  all)  as  n  was 
increased.  Because  of  the  size  of  these  problems,  optimal  solutions 
were  not  obtained.  Therefore,  no  normalized  deviations  are  given  for 
these  problems. 

Table  VI  shows  the  changes  in  the  objective  function  value  (Z) 
in  different  parts  of  the  three  procedures.  Z1  is  the  objective 
function  value  at  the  end  of  Phase  2  for  Procedure  1.  !n  Procedures 
2  and  3,  it  is  the  objective  function  value  at  the  end  of  the  first 
part  of  these  procedures,  before  applying  Method  5  of  Phase  3.  Using 
the  labeling  of  parts  for  Method  5  given  in  [16,18],  Z2,  Z^,  Z^,  Z^ 
and  Z7  are  the  objective  function  values  at  the  end  of  parts  2, A, 5, 6 
and  7,  respectively,  in  the  last  iteration  (if  any)  where  an 
Improvement  was  obtained  in  that  part.  Zq  corresponds  to  the 
objective  function  value  obtained  at  the  end  of  the  Phase  2  type  of 
search  in  Method  5.  Table  VI  shows  that  the  solutions  were  very 
rarely  improved  in  parts  A, 5,6  and  7,  whereas  the  Phase  2  type  of 
search  of  Method  5  improved  the  results  more  than  25%  of  the  time. 
More  improvements  were  made  on  Zj  in  Procedures  1  and  3  than  in 
Procedure  2.  This  strengthens  the  argument  that  once  variables  are 


CHANGES  IN  THE  OBJECTIVE  FUNCTION  VALUE  IN  DIFFERENT  PARTS  OF  THE  PROCEDURES 
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set  to  l  tn  Procedure  2,  they  do  not  readlLy  allow  further 
Improvements.  Procedure  3  in  its  present  form  gives  very  good 
solutions  and  is  very  fast.  Furthermore,  if  parts  2-7  of  Method  3 
are  removed,  the  algorithm  will  become  much  faster.  On  average,  this 
should  not  decrease  the  quality  of  the  results  significantly.  For 
all  three  procedures,  the  quality  of  the  final  solutions  perhaps  can 
he  improved  by  increasing  the  number  of  iterations  allowed  in  Phase  3 
or  by  trying  the  second  part  of  Method  4  (without  Method  1)  in  Phase 
3. 

Because  all  three  procedures  continue  with  the  identical  method 
(Method  5  of  Phase  3)  after  obtaining  Zy,  the  Z [  columns  of  Table  VI 
provide  a  direct  comparison  of  the  parts  that  differ.  This 
comparison  again  suggests  that  Procedure  2  is  quite  inferior  to  the 
others  for  Type  II  and  It'  problems,  but  probably  the  best  for  Type 
III  problems,  where  Procedure  1  and  3  perform  about  the  same  for  all 
the  types. 

Table  VII  gives  test  results  on  some  standard  problems  from  the 
literature.  The  A  series  problems  are  single  constraint  allocation 
problems.  They  were  designed  to  test  the  sensitivity  of  algorithms 
to  small  changes  in  the  right  hand  side  of  the  problem.  Therefore, 
the  nine  problems  are  the  same  except  for  their  right  hand  sides. 

For  two  of  these  problems,  A-5  and  A-9,  bindo  had  found  the  optimal 
Integer  solution  as  x^ ^ ,  so  Procedure  l  was  not  tested  on  these. 

The  best  solution  obtained  by  the  three  procedures  was  optimal  in 
five  out  of  the  nine  problems.  Two  Kaldi  problems  were  only  tested 


on  Procedure  l  because  the  right  hand  side  and  the  A  matrix  have 
negative  elements.  Even  though  Procedure  1  found  the  closest 
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possible  approximate  solution  to  the  optimal  solution,  the  normalized 
deviation  from  optimality  is  large  because  the  objective  row 
coefficients  are  small  (all  I's).  In  the  Pet  and  ST  series,  even 
though  the  solutions  obtained  were  not  optimal,  the  best  solutions 
obtained  from  all  three  procedures  have  small  normalized  deviations 
from  optimality. 

Table  VIII  give  a  comparison  of  the  best  solution  obtained  by 
all  three  procedures  (fourth  column)  with  the  solution  obtained  by 
the  pivot  and  complement  algorithm  developed  by  Balas  and  Martin  [2], 


Table  VIII 

COMPARISON  WITH  BALAS-MARTIN  ALGORITHM 


Problem 

Best  Solution 

Balas-Martin 

lzopt  ~  zneiJ 

lzopt  zneul 

1  zopt 1 

1 zopt 1 

PET- 4 

10 

20 

0.017 

0 

PET- 5 

10 

28 

0.003 

0 

PET- 6 

5 

39 

0.240 

0.0028 

PET- 7 

5 

30 

0.003 

0.0023 

ST  A 

30 

60 

0.021 

0 

ST  B 

.  .  —  -  ■ 

30 

60 

0.010 

0 

40 


Chapter  4 
Conclusions 


A  heuristic  algorithm  aims  at  obtaining  a  very  good  feasible 
solution  relatively  quickily.  Although  the  primary  motivation  of  the 
present  algorithms  was  to  provide  an  efficient  way  of  dealing  with 
the  frequently  encountered  integer  programming  problems  that  are 
beyond  the  computational  capability  of  exact  algorithms,  heuristic 
algorithms  also  can  be  useful  on  smaller  problems  by  providing  an 
advanced  starting  solution  to  accelerate  an  exact  algorithm. 

This  thesis  presents  three  heuristic  procedures  for  certain 
classes  of  Binary  Integer  Programming  problems.  The  construction  of 
the  procedures  was  given  in  Chapter  2.  These  procedures  can  be  used 
to  efficiently  obtain  a  very  good  (but  not  necessarily  optimal) 
solution  for  problems  that  are  too  large  to  be  solved  exactly.  In 
fact,  test  proablems  with  up  to  500  variables  have  been  successfully 
run  with  only  modest  exception  times.  For  smaller  problems,  they  can 
be  used  to  obtain  a  good  starting  solution  for  the  exact  algorithm. 

The  procedures  were  tested  on  different  types  of  problems  to 
evaluate  their  effectiveness  and  efficiency,  as  reported  in  Chapter 
3.  The  procedures  have  tended  to  perform  differently  for  different 
types  of  problems.  Procedure  2  tends  to  give  better  quality 
solutions  for  Type  III  problems,  while  quite  consistently  doing  worse 
than  the  other  two  for  Type  II  problems.  Even  though  Procedures  1 
and  3  seemed  to  have  similar  performances  on  most  types  of  problems, 
Procedure  1  seemed  to  be  slightly  superior  to  Procedure  3  on  the 
average  regarding  the  quality  of  the  final  solution.  However, 
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Procedure  1  is  somewhat  slower  than  the  other  two.  More  testing 
needs  to  be  done  to  obtain  statistically  significant  comparisons. 

Solving  a  problem  by  all  three  procedures  and  taking  the  best 
solution  is  a  promising  method.  The  execution  time  for  all  three  of 
these  procedures  should  be  relatively  insignificant,  compared  to  the 
time  needed  by  an  exact  algorithm  for  large  problems. 

Parts  4  to  7  of  Phase  3  (used  in  ail  three  procedures)  very 
rarely  improved  the  results.  Therefore,  these  parts  can  be  deleted 
from  this  phase,  which  will  significantly  decrease  execution  time. 

In  Phase  1  of  Procedure  l,  it  appears  that  the  first  definition 
of  Aj  and  Method  2b  are  appropriate  choices. 

Method  R1-R3-5  of  [18]  had  given  very  powerful  results.  This  is 
another  combination  of  methods  that  can  be  tried  for  the  0-1  integer 
programming  case.  Only  six  test  problems  were  available  for 
comparing  Balas  and  Martin's  pivot  and  complement  algorithm  with 
these  three  procedures,  but  the  limited  results  strongly  suggest  that 
the  pivot  and  complement  algorithm  is  superior  in  the  quality  of  the 
solutions  obtained.  More  testing  needs  to  be  done  for  a  definitive 
comparison  of  effectiveness  on  different  types  of  problems.  No 
comparison  of  the  execution  times  was  made  since  testing  was  done  on 
different  computers  and  in  different  programming  languages. 

One  important  area  for  future  research  would  be  to  extend  these 
heuristic  algorithms  to  mixed  integer  programming. 


APPENDIX 


This  appendix  presents  the  Pascal  code  for  Procedure  1.  The  labeling 
of  different  parts  and  phases  are  in  accordance  with  [16,18]. 


& 


& 


C>  t'» 


*  ♦»♦****  *  -w  xw  *  ★♦»»****  *  ir  ★  *  *  •+  *  ****  ★  ★  *  *  *  *  *  »★★*#♦****★**  ★***«★*★★♦**♦) 

*  * ) 

*•  Tne  p-rooss  of  4.hi  3  rroc'fi  is  to  find  £  5000  approximate  *) 

*scluti-  to  tre  foliouin'  Einrry  Integer  5ro;  r  ?mm  i  <03  problem;  *) 

*  V  ~  x  Z  ~  C  x  t  * ) 

*  subject  to  :  *) 

*  »x  <r=  a  *) 

*  x  =  Q  or  1  * ) 

*  *) 

*  n?r':  i'n  dijprsisn  cf  J  is  «  by  n  * ) 

*  7  u  ?  d  i  r.  or.  sio^ofSism  * ) 

*  Th?  di’isnsio''  of  C  is  n  *) 

*  rod  1 0 3  sot  0 *  foesibls  solutions  is  assumed  to  have  *) 

*  eo  interior  point.  * ) 

.  .».**.*  *  *  *  *  *  *  *  .  »  *  »  ♦  .  IP*..  ★***  *  *  *  *  .♦**  *******★**★★♦★*★  *★**★**★****★) 


x  *■» ) 

r£j:;sC‘;--:L:/CU’F:L5)  ; 

y 53  ••  c>.£  .  .odo::=  ?"iL; 

c  :_z  = -"  i y :i . .  s:p ::=  ~  f  p  i ; 
p a*-. :x=pfp.:y:i  ..5CD/i  ..s:::op  integer; 
pl*'  :r?:xsi?RiY:i . . 5 c 0 / 1 .  .5co:of  real; 

5l-£ t :g=: -  ^y ;i . .  5:::  0=  peal; 

: ;jtc  c l 3=  -  ~fa y  ci  . .  ecc:  oc  :nteger; 

:\t*  :*s  =  arpay:i  .  .*c::c=  integer; 

AF  :‘;-:Lr/:jT"L-:';/T; 

n  e  /. :  /  x ;  =/  a  t  - :  x  a  /  d  :  -  l  ■’  a T  r  r  x ; 

7  e  y  ~c  /  o  2  j  z  z  w  : :  v  cols; 

U /  J 5 R  I  :  :  INT:>  D ' 3 ; 
z*CAi/j-p'Z'-'"/S/r",jPo3/P’"<si'^iS' 

xi  /  ,  te"-  x,cs  rz^,  A3  ids; 

R  :  p. L--”IC/ 

EELXxLETC/CRCER/NEWC^RANGE/ELlGIElrsINTCClS; 

L  /  L  c I  ''1 E  /  C  *  I N  7  •  C  in’ S  / 

,M  x  =  5 1 •-•  E  :  **i  :  r:  x; 

/XF/XL/LiLTA;  .  ‘<*v  jL5> 

EL  f./Z  E  J1.’  E  :  ,  A,  T:’L  I  NEE  ,  ':j",  =  ,->  ,  G,  IN,  Z,  ZVt  L,F,  E/NO  ,  ,3,  C/ 

CONTI  /  CZJ'iT/I  ,J,X,:*.':'EX,T,CE  JVAL:  INTEGER,* 

CENT,  FESEIELE, 'UN  C/$T::,1C,EN  0-HAEE2/TERM  IN  ATE,SiME, IMPROVED, 

:iECNJ,3T?',I''R-,STt>‘>,:N'VEST:-*.s-=,ENC?i':’T2,END?ART3,ENDPAPTR, 
£\?-A?Te.,E*.  ;3A:?''b,!rN‘c-irT7/iNsGA$:2cc»-EfiN; 

5  ;  ”  :  *  /  T  :  r  ••,  /  E  E  /  /  i  L  r  -  /  3  J  "  L  /  :  L  I :  7  E  i  L  ; 

cp :te  p :  ; 


*  Read  t  n a  pro tiro 


pc  : :  c  l  f.  - 


■  l  > ;  v ; 


E'E'rr'ilC^^JVN  MiTlXAjPLPATRIx; 

■  r^'i:  eg-r;var  rjs ,cfg ?hs :  pcws  ) ; 
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Ujj 

i 

VI 

vr 


reah-ncnfile,?.); 

READLt,  ( IN  =IL" /“.); 

FOR  J : = 1  TO  N  00 

READ  (INF  iLr/  0£J50>.  OJ  Z  )  ,* 

OEADLN'  (IN FILE)  ,* 

FOR  RCW:=1  TO  00 
5  EG  I  N 

FOR  CCL:  =1  TO  N  00 
E  EGIN 

r  =  ad(  in -:l :x a:?: ■*, col:)  ; 

end; 

REA3LN(INcIL E) ; 

snc; 

FOR  I  :  =1  TO  M  00 


| 


RE  A  0  (IN  =:l  F  /■  -0  C  12  )  ; 

09  3  ?ns 

end; 

rea dln( :n=:le); 

RE  AOL.N  (INF  ILE)  ,* 

end; 

(*  <3c  d  tbs  solj*.io<'  z*  Lr  r?l=x?tior 

PROCEED?;  REA  0X1  (VAR  ZLIN  :  REAL)  VAR  XI:  COLS); 
VAR  J :  I  NT  E  j  :  “  » 

BE  GIN 

RE  A  EL  f.  (IN=IL=,  I  L I  N  )  ; 

F  C  R  J :  -  1  TO  N  CD 

reaocn  =  ilE/xi:j:); 
rsaoln(in  =  ile)  ; 

RE  ACL N (IN  FILE)  ) 


( *  Rscd  Essie  c3?'i':l  3  Eolutio-s  in  3  3 t  ting  x  2 ,  s  t  s^t  i  n  g  from  XI  * ) 
(*  T  o  1 1 1 n  3  s  xs  th.3  numb of  b-sic  fsssxols  solutions  read.  X?f  *) 

( *  is  t-'ic  n£  t  ri  x  forn?b  ty  sll  t  Os  fc?  si:  f^rsibl?  solutions  together 
PROCEDURE  rea:  E  =  S0LN(V  A'  XE=:RL*iTRIx; VAR  TCTlIN?  S  :  INT  EGER  )  ; 

VAR  I  /  J  :  I  N  T  E  G  E  R  ; 

BEGIN 

I:  =c; 

n  I L S  NCT  (  E  OF  (  I  ,\  "  I  l E  )  )  00 
BEGIN  I:=I+i; 

FOR  J :  =1  *0  fi  0  0 

rea  :  cn'-:le/v:  =  :i/ j:); 
f  ea:lncnc:lE); 


totlims:  =  :; 


end; 


( *  ? ?  k  ?  thj  nscssssry  -djjstm?n*.  s  recording  to  Hou1  n;iy  b?sic  *  ) 
( *  *Sc3ibla  solution?  r  s  d .  * ) 


PSCCECURE  ACJ  J  5T(TCTL  INES:  I’JTE  :  =  r';  vl :  CCL3;  X:  =  :  RLViTrrx  ;  num  :  INTEGER) 
V  A  F  XO:COLG); 

VAR  J:  I  NT  r  G5R; 

TEMPI,  TEMRR  :  Hi” COLS 


eo  j"e  =  =  vi *  3o,vi::-riL;vi5  s :row$;v;tp: xa:r lmatpix ; 

x:  ; 

Fir.  c  i h ;  slack  *or  each  inequality  and  compute  the  infeasibility  * 

i  :  »  ■  •  i  c  3  :  •<  / 

s 

SUV.  5:  =  c; 

=  3?  I  :  =1  TC  *!  CO 


=  03  J:=t  TO  N  j3 

asows jscio  +  cvatrixa ::,j3  *  xcjd; 
;?o^ s ::: :  =,2c‘ ows : : ’  -  rhsci:; 

:=  cf3\3C::  >  :> 

: j-;:  =sum:  *  :^r-jsc:3; 


Step  t  of  ^  h  a  *  e  2 


iZ'j ~i  3te c t  (x:  ::rc cue;  v:r  n=ko:rl vat? ix;  var  cstar:Cols; 

v:?  oelx : o\tc:l$ ; :rcws: ?c«3) ; 

1/  J::*:Tr3£R; 

SiCCLs; 


=  C 0  J  :  =  3  TO  f.  0  0 
5  :  3  0  \ 

Compute  Sj  fo'  3 ?crj  *) 

0 :  =  1  '0  "  00 

£-j: :  =  s:j:  4  vi^.-ixac:*- jo; 

Coirpjtj  hj.i  rj:n  erco  xj  sboul  be  increased  in  tne  favorable  *) 
cirection.  *1 

:  =  (o:j:<3)  an:  cxcjj<n  then 

o"lx : j: : =1 

:Lj  t 

(  3 : j :  >  c  )  r.:  c  >cj]  >  3)  ~-i=\ 

:e  lx: j  0: =- 1 
ELSE 

:•  e  l  x :  j  i :  = : ; 

Ccr.jiitJ  nj  rr"  3j 


.  f  r  n  it  *> 


j  j  :  =  : -o*s  :::  *  c -iatr:  x j:  *  delxcj:); 
:  =  1  -0  M  00 
a. e«::i/j:  >  o  >  the'j 

« 3  T  i  r  C  J  0 ;  =  '■  E  W  0  0 1  /  J  ]  ♦  OOTAClJI; 


top  5  of  r  r  a  ?  e  2 


U-.E  3TE-;(v:-  \  Eu:: 
x:  ;  :j TC  ole;  V  :  ' 
vj  *.  ro  j  j : / r  \  o-"'fj  -f.  o 


0‘0  r.  3  :  >0  .v'S;  ViT  0  F  LX  ,  y  c  :  \  TC  CL  S 
:  x  :  r  L  •; :  T  =  :  x  ;  v  : 0  :  3  f  4  0  :  C  C  L  3 :  S  U  * 0 :  P  E  A  L ; 

: :  *•  o :  l  •  a  % ) ; 
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1*  the  round  iolutio1'  is  tf  j  *  is  feasible/  *) 

is  b3C3T35  ins  cu'fc-r/.  *  ??si  Mj  solution/  other  wise  go  to  step  6 


i  -  -  ►  ♦  r  r  r  r> 


*:  >  0)  then 

6  (X  /  MATS  :  XAz  N /CST  t?,0  ELX  /  .;?CWS) 


c  ~  -  T  r  i  c  • 

;U'*  ■  I  '  J  .  / 

'll3 "  1 1 IZ  :  =  ~  t  u 3 ; 

; ;  j  :  =i  to  n  o  0 
v?:j: ;=x  :j:; 


:  of  ?3J:3  ’ 

$TE-10CXl/V,:CCLS;Vt3  £  L  =  A  :  P  =  £L  V  L  P  STP10:“OOLEAN); 
to?  vriu?  of  tip  hr.  iloha  gets  the  surliest  value  that  O 
ivc-  t1'-  CG<t  rognajd  *.  *) 

3  :  3  ; 

:  cols; 

d::o:3c; 

=  i  tc  u  :: 

( xi : j : >  = : --e*. 

3i  SIN 

:=  cx?:j:-xi : j :  <  n  then  eesin 

:=-(  cxi :j:  -  0.5)  /  cxz:j:  -  xi:  jm+o.oooi 


T  u  :  •  ’  r  1 


•  ~  1  ■  .  =  1  ;  ; 

*■  -  W  -  •  I  •  /  f 


::  <v::j:  -xi;j:  >  :)  them  =es:n 
:-je’::j::  =  cc3.5  -  xirj-)  /  c x 3 : j : 


T^ETi  :j]  :  =1 ; 
e  n  :  ; 

:=  (t-etacj:  < 

=  _-j  j:  ; 

.  l  r  a  :=•-*:  \  ; 

'  —  -use; 


xt:ji ) ) +0 . 03  01 


7 1  (  V  1  T  :  *  ~  '  n  -  - 1  -J ;  V I  3  I L  =  £  :  3  f  5  L ;  V  £  P  OSTiP  :C0LS; 


m. »  m 


u  i  y  ■  i1 1  ^  v 1  m  m  m  ^  i  u 1 »  J  i  u  y  'J  ^ J  ^ *  \p  >  ^ ^  1  ?  ri*  ;ip»  1  in »' m 1  m  « i*  ^  r i*  fj»  n*  n*  'in  ■  j  i  j  mi 


.% 


R 


■  w  ^ 


J  :  =1  t:  n  C 


CC'J. 


I-  (  C3Tir-ji  <r  SU"!  )  t-^m 

-  Z  “  •  M 


L : =  LA  1  ; 
l  5  r ; :  L  ] :  =  j  ; 


end; 

:=  cl-t;:i:  =  :)  th-, 
stsi:  :  =Tr-j:; 


C*  Th?  st?c  rjol-rciiQ  st  s  c  7  of  3  has  ?/  w  hen  this  oh  ase  is  used  * ) 


end; 

C*  Th?  st?c 

(*  in  •'? 

t  h  o 

PR  CCECIPE 

S  7 

Vi~ 

K  : 

C  *  .=  i  n  o 

th? 

VAR  1/  T/ J 

:  IN 

*) 


*) 


K  A  X  r  :  P  £  A  L  ; 

P :  l  CL  $  / 

BEGIN 

Mix3:  =-i:  :; 

f c %  t  :  =1  tc  rj  : : 


I-  *.  C  T  (  L  E  *  *.  C  *  ;  =  ~  : 

^  -  J  -  1  • 

j : =l  : ;: ; 

:,=  ccr:  )  then 

3 : j: :  =  sun :  -:sTi?:j: 

ELSE 

- : j: :  =  cc:  j- : -c:j>:e.v c jr >  /  c;u-‘i  -  csta?  rj?) ; 
:=  <  - : j :  >  ■:<-  )  t-e*. 

a  ;  *  * 


:  j  -  < 

i  t 3 :  = 5 :  j  : ; 
n  :  -  j  ; 


_  *  j  / 

E  *.  j  f 


em; 

( *  ‘ire 

th 

( ■*  u- ir.i 

'*■ 

?  r  c  c  e  :  i  e  : 

VAR  S 

1’  ■■ 

VAR  J  :  i'.i 

Z  J 

M  A  A  r  :  >  £ 

A  L 

(  *  ■ i r  d  th?  Veri?ol:  -  h i : h  j  i  1 1  i;k;  tr?  1  r  r  ;  ?  s  t 


i^orovsTgr.  t  without 

O 


L£/*!r’I''EE:h,<:C,-,JJ‘;vir  K  :  I  ‘J  T  =  G  E  3  J 


3 :  c  cl  : ; 


3  C.  J  . 


.■'AX 


•  J  Jt  / 


FOR  J  :  =  1  T  C  K  C  ? 
r  :c  i  J 

if  =  'a'  >  T u:-n 

?:  ji :  =  :-ar  *  r. 

"L  £  E 

•’C  j:  :  =  ccf  j- :■/ :  j> : : j:  )  /  (u-fi  -  csta3  :j])  ; 
:=  c  ■>" j:  >  ’ 1  i > f  )  -■•Ef-. 
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prccecu-e  -i-.T Tr:>=  -  ;3:  =  :ws ; j»cw/X:  tktc  ols; 
sa  t  :  :?l  <atp  iv;  v  0  :  fL'1:’1::  x>; 

C*  Co^p'Jt;  :ij  »sc^  i  rnc1  j  *' 

var  L/  i,j  :  :r.r  eger; 

A/T : real; 

BEGIN 

FOR  I :  =1  TO  f*  0  0 
BEGIN 

POR  L: = 1  TO  N*  00 
BEGIN 

j: =  order  :u; 

I  =  ((CBJRCWCJ:0)  AND  CXCJ3=D)>  Co  C(03JRCWCJ3>0) 
AND  <  x:j:  =  1 >  )  then 
::i/j::=: 

:  lg: 

EE  GIN 

T:  =  DEJ-0*'u  J> ‘‘.ATRIXACI,  J]  I 
1-  (  T  >  ?  )  THEN 

BEGIN 

1=  ( MATRIX ACI/Jl  <0)  THE  N 
A:  =  -i*vatrixaci^j3 

ELGE  .  . 

i: =matr:xaci/j: ; 

DEI/ J  3  :  =  S  CII/a; 

end; 

if  (<*<:>  c»  (••:T;ixi!::/j:=?))  then 
d  :i/j :  :  =  i oogcjOd; 


end; 


!*  Itsp  C  :?r*.  I  of  ;i“3:3  j  *) 

PR  GC  ED  JPE  =  ART  0  2  CM  :  I  N  T E  G E  R  ; OR  0  =  R :  INTCOLS;  VAR  NEWD:  INTCCL3;D:  RLHATRIX 
(*  CoT'-ut-  cj  'or  >-ch  j  *> 

VAR  L/  I/J/  -!IN:  INTEGER'; 

C  *<J>  <1  « 

-or  l  :  =  i  to  r.:  :o 

s  cw  I  N 

v:  *; :  =1 : ?:■; 

J: =0^0; - zl i ; 

FOR  I : = 1  ’3  M  DO 

BEGIN 

:=  c::i/j]  >=:j  t-=n 

N-,;::j::  =  rr  j--*  (ocr  /j]) 

:i_t  : 

n : i-io ■  j:  : - :c:  i  /  j:  -i  > ; 

I-  (-.:  >■  :j :<••!•. )  ’-e*. 

■•••:  =n  - :  j^; 

i  >  *'  • 

-  »  -  / 

Nf  h  :  c  j:  :  =mi  n; 


»Vr v ... 


PR  3CEGU  3E  3;->  T2  :  ( N  E  :  IME  3 E  ?  A  V  A  p  A  -  :  COL  S  /*C  5  0  E  R  /  T?«s  C  ,NE  WD  :  I  NTC  CL  S  )  ; 

(»  Coufjt?  R  j  •for"  wsricdi:  with  n3v:;ro  objective  row  coefficients 
VAR  L/  J  :  4  NTE'j  :  '  » 

BE  GIN 

FOR  L  ;  =1  TO  r.o  DC 
:  :  j  I N 

j  :=croe^:l3; 

ar  C  J3:  =  T EVP  c:j:  *.new  jCJ3; 
e  / 

E  f  j  0  /' 

(*  Step  E  of  3srt  2  cf  5h?se  3  ** 

PRCCEGJ-E  RARMECVa:1  T  EM  3C  :  IM  C  CL  S  ;  K :  I  ME  0  5  R;  V  A  P  $ : POW S ; 05 J RG W : INTCCL 
mat  ;x: :  rlvat?:x;vap  x  : :  n  -  c  c  ls)  ; 

(*  Click  th3  si;r  of  ’k 
var  : :  in- e ger; 

if  ( C  E  J  p  0  W  I  <  3  >  0)  A  NO  NOT (X :k 3=1 >  then  I 

e  e  :  n 

x  2K  2  :  =x  3  \3  *  1  •  j 

FIT  I:1*’’!''1  00 

5  c ::  :  =  s at  ?:<i  rr  n; 

E  NO 
ELS  E 

IF  'EEJRCMO  <  0)  am  (x:c  =  n  then 

BEGIN  j 

x  :< : :  =  x :  t  :  - 1 ; 

FOR  I:=1  TO  M  OC 

s ; i : :  =3: ::-•••■  atrixa:i,<3; 

* 

E  NO 
ELSE 

te  ?c:x3 :  =  : ; 


(*  Step  A  of  Fsrt  2  of  “hr.-s  2 

PROCEDURE  =ART2ACO?J?CW,  0-  0":  INTCCLS:  •■•ATRIXA:  PLV6TRIX  ;VAR  S: 
var  x/TE*'-:  ::nt;ol integer ;ar:ccls;  var  ^integer; 

VAR  EM  PA  R  r0: :  SOL:  AN)  A 

t  ^  £  n  *  x  i  ^  j  31  r  ?  nj  c-3t  k  to  t  h  £  index  of  the  ni  c  y  i  m  u  hi 
VAR  "AX  :P.  EAL; 

L  /  J  :  1 1«  T  r  S  c  R  ; 

Bo  G  .  N 

ma\:  =  -i  emcee:; 

c0 k  L  :  =1  TO  V.Z  O'1 
BEGIN 

J :  =  C  R  0  E  -  .  L  3  f 
I-  (a-:j!  >  •':*>  TM\ 


rows; 


"A  x :  =:  R :j 3  ; 
x  :  =  j; 


F  C  A  R  2  X  3  >E)  T--N 

3  - r  T  2  '  C  f  p  C  /  <  /  “  /  0  0  J  R  "  V.1  /  '•'  A  T  p  0  X  A  /  Y  ) 

ELSE 

:mpart2:  =  ttu:; 


Nil 

f 

a 

>3g 


PROCEDURE  P A3T3 (ND : IN^  EG?3 ;03DE3,0  5 JRC W :INTCOLS;VA  P  NEWP/PPRIM  BEATRIX 


(*  Co'r.puts  Pjk  end  P'jk 
VAR. 

o:v:;: cn: real; 

B c  oil. 

FOR  J  :  =  1  TC  ri:-i  :o 
BEGIN 

l:=g=:e^:j: ; 

=  0R  <:=J+1  to  n:  do 


: = o  ?:  =  p  c<j ; 

o:v::: dn:=:5jrowCl3/02 jrow:m]; 

:=  <c:v:s:cno>  then 

DI  V  IS  10  N  :  =  D  IVIS  ION*  (  ”1  )  ; 

ne\-:l,": :  =trun:  (c  ivis  i:n-d.ocoo:ood  ; 
=  -  •:■••=  :l/*'::  =  ’-.jnc  (divisicn+u  ; 


e  n  z ; 


( *  5  T  a  p  2  of  3  r  - 1  a  of  ^  ’  ~ 

r ?.  c c e : G r e  - 1- -a: Co :  :nt  egs3  ;v*. 3  s33  :ve,  s  :rcus;:elta  ;  intcols  ; 

y  a  T  ?  :  x  a  :  pl^a*a:x;  v:~.  irlNTCCLC); 

(  *  Co  hp- to  s  * 


l:  =  :; 

=  :■.  : :  =  i  to  ••  :o 

5  i  j  I  \ 

3-r:  ••*e:::  :  =  s :::-  (o:iTiCj>MAT?:xa:i,  j]); 
i"  < spr: ne:i io  t«=h 

BEGIN 

L : =1  +  1  ; 


"’ODEDo-'E  3:3t-kva?  s  ■»?  :f-  -,s:  rons  /“■'at  r  ix  a  :3lv  atp:  x  ;va  p  o:  intcols; 

J::M£iT-“;X/?5LTA::N*CrLG;viR  END3  APT 4  ,  INVESTIGATE  :  BOOLEAN)  ,* 

>  I'.jc*  t-e  si:-.  o*  (xj  +  d:-Itrj)  *) 

-  C  Jii 

:=  cx :  j>delta :j:  >=“:  and  <x:  j>delt£Cj]<  =  :) 

EE  GIN 

IN  VEST! gat:  :  =  ue; 

P  A  -  T  i  7  (  J  ,  S  ‘  3  I  *■' 3  /  S  /  D  E  .  T  A  ,  M  A  T  R  I  X  A  ,  ) 


;  E  G  I N 

El.:  3  a:  T  -  :  =T  'UE ; 


vzW 


N-!-CCLS;vaP  X  :  INTC0LS;VAR  S:  R  C  WS/‘  S  PR  I M  E  :  R  0  WS 
::-AT  ?  0  CLEAN)  ; 

*) 


i'j:  ; 


5 ■  i  ?  j  /  < 


\‘ :  :  VATRI  x;  X/05J"0W  :  !NTC  CLS; 


c  " )  t  h  ?  r-: 


k::\’  =  c-e?;var  u:  imrca's;  s=r  ime:  rcws; 


cv 

£«•, 

,y. 


PR  C CEIL  RE  5A;T£?<3D5:vE:5CW«-;''4'r?IXA:t,LVAT5Ix;K::N'rEr;='? 

var  l:imtscws;^ : intpows) ; 

(  *  Co  "ipu  t  ?  Lk 

var  :, vax^t/I: :n-=ser; 

V: real; 

BEGIN 

m  a  x : = - 1 :ooo32:; 

FOR  I : =1  TO  M  DO 
BEGIN 

: -  not(7  =  “)  ’■hen 
BEGIN 

v:  =  (s»r:me  :t3/matr  ixa  ct,!0  ) ; 

:=  (v<j)  HEN 
I :  -  T  *  ij  \'  C  ( V  ) 

ELSE 

2  :  -  7 ^ 'j  *l  Z  ( V  ■‘■D .  0  ?  ?  0  ?9 )  ; 

IF  ( I  >  "  A  X )  HEN 

vex: =:; 


END  ; 

LCC:  =  ••  AX ; 


end; 


(*  $  t  2  3  A  o*  “rr  *  f  of  "h?32  2 

FRCCEIUFE  6A(^  :  IVT  “i-i?  ;  3-5:,,c:  j;  V&-9IXA  : K- L V a TS> r  X 

var  u/ j E:iN75:ws); 

C*  Co  .71  put  2  !jk  Ij'k 

VAR  HI  N  /  V  /  C  O'JN  7  / 1 :  I N7  E  GER  ; 

T  : E  A  l; 

B  c  o  i.  N 

'  ^  I  «  •  I  M  «  J  w  «  J  ••  # 

for  : :  =  i  ’o  •i  :o 

BEGIN 

1=  (HA7RIXA II/Kl  >C )  THEN 
5:  GIN 

Ti-CS^RIME'II/^A'RrXAUI^K]); 

1=  (7>  =  D)  T  H  E  N 

V  :  =  7?U*iC(7) 

ELSE 

V  :  s-p  UNC ( T-1 )  ; 

IF  (  V  <**  I N  )  THEN 

:  n  :  =  v ; 

C  CJN7  :  =  ' 0 ’J*jt+  1 ; 

end; 

end; 

IF  C  C  OUNT  =0)  7 HEN 
U?  R  I  C  X  ]  :  =  1  DD  D  GOOD 
ELSE 

u^ri.-eck::  =  vin; 

IF  CL?5I,,EC<]<"JlK  2)  THEN 


procedure  fa;:t6o(3pa'ivi:pc'/j3;*,atrixa:rlmatrix;vap  U/UP  p:«?  :  in  trows; 

<:  I  NTEG  E*,'  l  :INT  ?C*JS  A  VAR  END  P  AS  T  6  :  E  0  OLE  A  N  )  ; 

(*  Check  if  Lx  <=  Uk  *) 

BEGIN 

if  cl :<:<=ucc  )  the*. 

PA  *  TEA  if.,  Spp  ~:x:,U/UcrI,-,E  ) 

ELSE 

en:  =  a~t6  :  =  t-  lie; 

Ef.  3/ 


(*  3t5pEc*PsrtEo-f"h?e?3  * ) 

P  R  0  C  E  C  L  ■'=  Pi-Tce(OEjPCV::?;TCGL';j/<:IN'EGEP;VflP  E  N  D  PA  R  T  6 :  S  OOL  E  AN  /' 

VA -  l: I\*~C* g; v S/SP“:m=: 5?ws;VAR  X: INTCOL e;m ATRI XA: rlmatrix 
C  E  L  ■'  A :  I  N-  :  G  3 ;  ’J  :  I  \ T  *  S  ;  V  A  Z:  IK.  7EGER)/ 

(*  Crez<  t  re  si~n  ov  Ik  ir  c  -*  E  c- r  t:  select  the  inD^ev  ed  solution  *) 


if  c e jp: «:<:>: )  a» 


<  1  )  7  -1  3  N 


x:j::=cj:- 

X  C  < : :  =  *  ;  <  2  ’ 
3  "  :  *  :  =  *.  5  : 


r:xi  r:,Kj); 


c * e  j ; G ; *  :<  = 
eigen 

< r  j:  :  =  <c j 
xCC:=*C< 
s : 9  : : =i 
SCI.  :  =  3 


■(lc<>--,a’r:xa::/*o) 


3 :  =  1  TC  ’ i  ZZ 

z:  =  :*<x  j-c 


>  t  e  p  5  of  =crt  6  o' 


EZuP.E  ‘  A  r  t  o  5  <  J  /  <  : 


V  -  •  i  / 


L  :  ’  r  r.:  3  ;  Vi : 

C  r.  e  c  x  if  L  ■  <  -  L  k 


JPG  W/GEL’A: I\TCGLS; VAP  l: IN  TROWS? 

X  :  ;  M  :  •?  L  !  ;  M  A  T  A  I  X  i :  P  L  N-A  T  ?  I X  ;  V  A  R  Z  :  I N  T  E : 
:  *  I  n  L  E  A  \); 

*> 


( l c <  ="j ; k : )  r- 


fr-,L,5,S=RIME,X,,i:.T?lXA,hELTA/U/Z) 


<*  Fart  1o*  Phase  3  *) 

OCEOL?E  ?u--T1(/=::‘jTC?LS;v;=  0c‘0E*J/?3J5CW/T?vPC^-cLT4:INTC0LS; 

Vi  “  \3  :  IN7 E  GSR ;  Vi  ?  S  :  RO WS;  P  H S :  <?  CL'S  ;  MAT?  I XA  :  ? LMA  T R IX  ;  X :  INTCCLS) ; 
VAR  ?:  INTEGER/* 

BEGIN 

CART11(X/XF); 

?iP“i  ?  (“3  ?:•-■'  /  c.  ~j;c w, 7 c=lt  i/ no  ; 

FCR  r : = 1  t:  N  GG 

».”t:c:l;tc:lE/x:p:); 

wpitilnout^ile); 

=  ART13(S/Prl3/MA~R:/A/X>; 

eng; 


(>  -art  2  rh:s:  3  *) 

prcceclre  :  :nte  :•=  =  ;  N0::‘!TEG  =  p;viR  s:pgws;c?ger/  objpow:  intccls; 

v  a  ?  x : intcois; “a  t  ?  2  <  a :PLviT=i x;vap  c: rlmatrix; va?  newgiintccls; 
va?  A5::cis;vi?  t :  :nt:cls  ; va?  eng^attz :  =  cgle a v) ; 

BEGIN 

LhILE  NCT  (  ;  UZP  ART?  )  GO 

C  “  ;i'l 

°i?T21  CN3/  3/  0?:  =  ?/  0e  JPOA’/X/'-lATRIXA/ j); 

?  a?t::  c :*:=  o )  ; 

?  a  ?  ^ :  3  (' no  /  a  ?  /  c  ?  - :  ?  ^  t = ’•*  ?c  /  n  =  wo ) ; 

?  A  ?  '24  CCl  J  /  0?:i  ?/‘,i  X  A/S  /  X,TEr  =  C,N0/i  P/X,  ENDPART2)  ; 

=  m  : ; 

RESULTS  (X  / ELIGIrLE  / CEJ?r: « /  2/2); 


(»  Rar t  a  of  ?FcS 3  3  *) 

PS  CC  EG  UrE  =A?  *  A  ( J  :  IN*  E  G?p;  Vi?  $  =  RI  ME/ S  :  ROWS/*  Vi  R  X/ GELT fl : IN TCOL S ; 

MAT?  2  X  A :  -  L  A  ”  •  2  X  ;  V  A  *  G::*.'CGLS;VA‘  ENGPA5T4/:  WES  TIGATE:  BOOLEAN) 
va  p  ? :  :nt  ; 
c  2  GIN 

?i  (  s?  TIME/  S/Mi  Tr  :x  i/C,  J,y./  G  =  LT  A/ENDPAPTA/IN'VES  TIGA  TE)  ; 

1=  t;CT  (ENGPiP-A)  ta'.N 

=  A?,  T  A 3  <  G  r  L’  A  /  0/  X  ,  3 /  S  =  ?I  ”  3 /  E  \  G  =i  P  T 4/  2  N  VE  3  TIG  1  T  E^  /* 
:esl,lts(X/El::ielE/':?j??///:/A); 


(  *  Step  ?  of  =hc.s3  Z  u>  >-> n  dif-*ers^t  orrts  ?f3  fitted  togather 

?k c :egl‘?e  c~e: ks-p  =  c:r ?:  :ntc  :ls;  no: : ntege?; v a?  a  / T/ j /  < : : nteger; 

VA  r  CJECXJ  :  ‘'GL  r  an:  ; 

( *  CnscK  i  *  j  <  ^ i "i  (^-•/r'-‘n 
VAR  M  N  :  I ,  "■  *  3  E  :  ; 

S  =  G  .  N 

IF  ( :« C  < N~  1 )  T^:r. 

m I: j  :  -uZ 
ELS  2 

v :  n  :  -  •  - 1 ; 
if  (a  < 

£  -  j  k  \ 
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T:  =  3^:":c::<?=LTi:r>-??i-:rj/K>.UTPixflci,KD; 
1=  ( T  <0 )  TS=N 
I n -Ei  3:  =  T  “ue; 


C  riC  i 


end; 


(  *  Pfi  ~ t  5  cf  51533  3  * 

p?  uCedj-e  =art  5 ( i: :ntr  cw :; j,x : inte  ger ; newr : vat  r:x ; vc?  x : in tcols; 

05J»0W/DELTa : INTC3LS  ;  V4  5  L  /  L  PRIME/U: I  \ T  R  C  WS  ; VAR  S : ROWS; 

S'RIMZ: RCW3;m«TR IXJ; PLMfiT?:x ;viR  END5-RT5:200LEAN); 

Be  GIN 

PA  P T5  1  C  J,  X  ,  Nrw  r  ,  y  ,  j r  L  )  ; 

parts  ( =  ; 

?AisT53C'‘IT*.  ;XA/S/L/L  =  r  IMS  /X/U/  St.'S  P  A  F  T  3  )  ; 

IF  NO”  (St.1  OPART  5)  THEN 

pART5  0(X/J,K/P/SPR:M;,OBJRC../DELTA/,HATR:xA/Z,L/U,ENDPART5>; 
rssult3(x/-sl:s:sle/:  =  jrow/I/5); 

en  c  ; 


<*  Part  5  cf  Phssa  3 

PROCEDURE  =-RT5(j/K:I‘j“"3S“;“ELTA/0?JP0W:lNT"9LS;VAp  L / U/U PRI HE : INTRO r 
;  ns  w  r  a  -  ?  ;x ;  :  \*  -  o  us;  v  a?  s  /  s  =  r  ;*'= :  rows  ;  mrt  -  :xo :  rlm  atr  ix; 

var  3  \j :  : r  o  c  l  r  a  n  ;  v  a  3  x : :  n-c  c  w  s;  v  a  5  ::  integer); 

BEGIN 

PAR’61  (  J  /  K  /  0  3  J  7  j  w‘  /  IJ,N  =  '.,'5)  ; 

?A  RTj  3  (  35  R  I  ’-.S  /  “.  iTP  IX  A  /  K/L/  3)  A 

FA  RTs  3  <  S  =  R  Z':i,  'f-~?  Z* -,U,U~?:'*z  /X/L  /  END5 ART  f  )  ; 

:=  NOT  (SNO-A-Tt)  T-EN 

PAFTer(J/X,01J-r,'/-c’.”A/L/S/37=:vS,x/vi-o:x:,Z/LUEN0o:PT6); 

RssjLT3(x/SL:j:s'_E/SSJ3cw/i/i); 

enc; 


( *  Part  7  of  P1'-:-:  s  3 


O 


pr ccssu-s  ?a?” ” cor  : -? :  :*:’C  cls;  va?  in=?a::soole:*!;v4r  a ,T/X : integer; 
j : : nt s  3 er ; v a7  y:: stools; vi?  s=  ?i**S/ s: r ous;  deit a :in tool s; 

:t;  s :  hat?  :x; -it?  ix  : ;  r'.HiT  ?ix  ;  vcr  end  ?  art  7 :  socle  a  n;no  :  integer)  ; 


VAR 


b  ”  ;  '  £  :  i  0 


J  ^  ■*  J  -  '  f 


BEGIN 

ENOPA 5T7: = =ALO =; 

:=  (  (x[j:-osltasj])>  =  :)  tus.j 

BEGIN 

RF3  ."I  (  J,  3?  ?:••!£/  S/D  ELTA  r ‘'AT  ?IXA  )  ; 
3~S?3:-T0jE; 


ELSE 

SNDPAR??;=’RUS; 

/.HOLS  (S’  3  7  2)  AN  7 

s ;  gin 

1=  <T  >■;?)  T-iON 
END "A  RT 7 i-r ? us 
ELSE 


NO” (END  PART  7)  DO 
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( *  Cre  ck  1 


si  in.i-'wed  iz  'curd 

=  -RTo(jrK/:EL^-rC*j=ow/L/,ji-L;?;::y. 
r.CT(ST=7)  T  J  E 
e  =  :•:*  j 

zval:  =  o; 

=  ;p  3 : =1  TO  N  CO 

ZVAL:  =  :VAL*(y!:G3*O^JPOW[3D> 
1=  (IV  AL  <=  Z )  THEN 
:/  =  -OV"0:  =  =tLSE 

EL  S  E 

m-  *cve::  =  t^'je; 


,NEW?/2, S/SP RIME/ MATS  IX A  . 


(«  Initial::’  all  tn?  varisslas 

PRO'  :  jli?  :  I  f,T  ”  '  AL  T  Z  E  (  V  A?  C  OUN  T  E  5  : 1  NTE  3  E  ;  V  4  “  °  0  S3  I  3  L-r  cOUN  Q*T  E  RM I N  ATE  / 

-  ?  j*3i  I/I',  V:3Tr3ATE/5NC3A~T2/ENO°A:vT3/ENODflRT4/ENOPART5^ 

^NO-A'Ti/ENO^A-T'7  / SA‘-,r/I'’Bi'0'/  =  O/  ST‘:0/STP6rC HE CKJ:eCOL?AN; 

:i  L'*' :  I  NT  1-3"  -  ;  V  A  P  0:  I'!T=Cv.'S;  <Mf  OROE  R/LE  TO:  INTCO  LS  )  ; 
v  a  n  :  /  j  :  i  M :  j  e  ? ; 

£  £  G 1  *« 

Ef«0FAw72:=FALSE/ 

£  \  3  =A  c.  '  2 :  =  F  A  L  S  E  ; 

ENi?A  '  TA:  =pal3E  /* 

E!,3rAr'::=-AL3t/ 

ENu=AF’i:  =FALSE; 

EN  3  ?A  ?.  T  7:  =  "  A  L  3  3 
SAME:  =  =  AL3E; 

;vB3CVE0:  =  =ALSE/ 

r  „  j.5-1  :  -  -  w 

Cl--!".' 

CHECKJ  :  =  ~  ~  J  E ; 

S  T  ‘  3  :  =  T  •  U  E  ; 

S T  c 5 :  =  T  “j  ;  ; 

INVESTIGATE 

FOR  j : =1  TC  N  :c 

E  EG  IN 

LE ” Z~JZ  :  -  Z  / 

c*.  :  = j  3  :  =  j  ; 
e  \  j ; 

FOUND  :  =  =  AL3E; 

TE  ■*  N  A  ’E  :  ==AL  3  E; 


£  \  0  *  h  A  3E!:"  =  ALSr/' 
'C3*IELE:  =  '-.  J:/ 
COL  NT  E  5  :  =  0; 

3TF13 : =FALSE; 


N'JH :  =mjN*l 

els:  BLr: =fals=; 

end; 

E  :i  G  ; 

CC.MT: 

RESULTSCX^ELIGIELE/DSJPOWrZ/l); 

(*  Phase  3. In  this  ? has?/  on?  tries  to  improve  the  solution  found  *) 

(*•  in  Phase  2.  Tbo  alternating  modes  and  Phase  2  type  search  are  *) 

(♦used  for  this.  *> 

Pfi  PT1  (  X=/0P?=P  ^15  JPOV/  TE^  =  C/ DELTA  rfiOrS  /RHS  /•'■flTPlXA  /X); 

FARTS  (N2,0Pj£3*DBJP0<J,ri=KP,PDR  I"E); 

WHILE  NOT ( SAME )  DO 
£  E  GIN 

(*  First  moae  *) 

?  A  FT2  C^/NO/SxC3"'?  p  /0  =  J  50  W  /  X,  if  A  TC I  X  A/ D  ,  NEW  0/ A  R/  T  EM  E  NQP  A  RT: 

=  C 3  E :  =  1  T n  N  DO 

XLCE3:=xGE3  i 

4  :*1  ; 

T :  =  •; 

J:=C30E3'fi3; 

k.  :  =op  de3*:t:; 

v;r-:i_E  (C-EGfJ)  DO 


(«  Second  mo- 


P  4RT4  (  J,  $  PPI  -1E/S  /  X/DELTflr  MAT5  IXA<  Q/ENDPARTA^I  NVE  STI. 

I-  (INVESTIGATE)  T  HE  N 
=>  E  G  I  N 

HI  L  E  (C  ONT)  AND  ( NO  T  (I  MPR 0  V  E  D)  )  DO 
2  ESIN 

CHECK$T3A(J,Z/K,ENDPART5/ENCPART6. 


1 1  /  f\  A  T  R  I X  A  /  0  E  J  v  3  W  /  _  z T  A  /  X  )  . 


I*  ( “JOT  ( I“'D  p  0  VE  0  >  )  CR  (STP7)  THEN 

:: r  ▼  * • 

1=  (C--1)  >  A)  THEN 

BEGIN 
T :  =  t  - 1  ; 

X:  =  CRDE  R  CT  3  ; 

EN  D 
ELS  E 

C  ONT; =false; 


T  :  =  a  *  1  ; 
k:=0ROERCT2; 

Efp ; 

eAPT7(DPDEr^"'N,:EAS/C^T/K/J/X/SPRIME/S/DEL" 
C  - S :<ST ’3(0  PDE3 ✓ NO/ A ,T/ J,K ,CH£C  K J) ; 


CH‘CKSTP10(SA''E^X  /  XL)) 


r  :  s  u  l  ’  s :  x , :  l  :  - :  * 
(•* :  -  “■>  1  ; 
r  2  L  G  I  =  ”  *■  L  S  I  / 

r  C  P  *  :  =  1  T  3  •:  ~  0 

C  C  J  * 

YrZ-  ] : =v;c:; 


•r.“  ^  I  n  n  ^  Q  >  • 

.  :  .  .  /  v  J  -  ^  /  .  /  :  >  ' 


: =~c  = jrow:c:; 

3  us:  =  (0?  J  =  OWl  =>x  Cc])  +sum; 

r  N  »•/ 

( *  Phfs?  2  typ«  ssrrch  o<  ’l«thod  3  of  Phass  3  * ) 

(*  itfc  t*is  ns.  cor.strnnt  * ) 

rhscm: :=- ( suv*i ); 

FOR  P  :  =1  TO  M  DO 

S  CTE  ?.  M :  =  S  C  T  E -  ■‘■3  D  ?  (  Y  A  *  R  I  X  A  C  M/  P3 )  ; 

Tc  k ;•!;  =Si‘T(s:T:PM)  ; 

F  c  R  P  :  =  1  T  0  N  D  0 

k,ia7Plxirv,/3I:”ViTPlx£uvi/3D  / 

shs:.'*: :=?!hs:y:  /  term; 

STEFA  (  3  U  M  C  /  D  *  0  '*  S  /  '*  t T  7  :  X  4  /  x ) ; 

WHILE  NOT  (FOUND)  AND  (COUNTER  <  100)  DO 
c  z  j  .  4 

S  T  =  ~  5  (NE«*D/DrOW3/CrLX/Xc  /  X  /  N  A  T  51 X  A  /0  S  T  AR/  SUMO  /  F  OU  NO/ ENODH  A  SEj 
STEP  ?  2  (05  J  =  3«I/C5I  T;PI0N/</5U‘-1D/DS7AP/DcLX); 

STEPS  (</.X/>05L  X/OPOWS,  NEW. 0,;S TAR/ SUM3)  ; 

COUNTERED  OUNTERfi; 

END  ; 

Rc3ult5(x  =  /El:o:elE/:ejrow/2/P); 

(*  Computa  trs  sa'Jir;  root  of  th®  sum  of  tho  sau?re  of  Cj  *) 

(*  far  j=1..n  *) 

CE  V  :  =  C  ; 

PC R  P : = 1  TO  N  00 

DEV  :  =  DE  V-3:= ( :=J  row: P2) ; 

IS  V := SORT ( DEV)  ; 

write  lnout=:l E/de  v) ; 
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